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DETAILED DESCRIPTION 



[Detailed Description of the Invention] 

[Field of the Invention] 

[0001] 

This invention relates to the configuration of a memory module, and the topology of a 
memory subsystem in more detail about a computer system memory. 
[Background of the Invention] 
[0002] 

The main system memory which may be constituted according to the necessity for an end 
user is adopted as many computer systems. In such a system, a mother board or a system 
board may also contain many memory expansion sockets. The one or more small circuit 
boards called a memory module may be inserted in a socket if needed of increasing the 
memory space of a computer system. Each of a memory module contains typically two or 
more memory devices which give the memory space of a given quantity. Generally a 
memory device is given using a certain type of a dynamic random access memory 
(DRAM: dynamic random access memory). Some DRAM type examples contain double 
data rate SDRAM (DDR SDRAM: double data rate SDRAM) various type with 
synchronous DRAM (SDRAM: synchronous DRAM). 
[0003] 

In the conventional computer system, a memory module is connected to a 
memory/DRAM controller via an address, control, and a memory bus including a data 
signal. The computer system which may multiplex, therefore may share the same wire set 
also has an address, control, and a data signal. The computer system which may use 
another wire also has an address, control, and a data signal. When each of an address and 
a control signal is inserted in the case of which, it is sent to each extended socket so that 
parallel connection of the memory module may be carried out to a memory/DRAM 
controller. If the system which may exist on the same integrated circuit (IC: integrated 
circuit) chip as a system processor also has a memory/DRAM controller, The system 
which may exist in one IC (for example, north bridge) of a chip set also has a 
memory/DRAM controller. 
[Description of the Invention] 
[Problem(s) to be Solved by the Invention] 
[0004] 

Although it is continuing accelerating the working speed of a computer system processor, 
the relative performance of the main system memory is not necessarily high at the same 
speed. It can become a cause that this has at least a gradual improvement of the 
bandwidth of the memory bus architecture selectively mentioned above. 
[Means for Solving the Problem] 
[0005] 

Various embodiments of a system containing two or more memory modules are indicated. 
A host is combined with a chain with which serial connection of the memory module was 
carried out in one embodiment. 
[0006] 



In one specific embodiment, each of a memory module may also contain a memory 
control hub which may control access to two or more memory chips on a memory 
module. Serial combination of the memory module is carried out via two or more 
memory links at the shape of a chain at a host. Each memory link may also include uplink 
for transmitting a transaction to hosts, and a down-link for transmitting a transaction 
produced from a host to the next memory module of a chain. Each of uplink and a down- 
link may be a one-way link including two or more signals which may transmit a 
transaction using a packet containing control and a configuration packet, and a memory 
access packet. 
[0007] 

In another specific working example, a memory control hub may decode a transaction 
received on the 1st [ of the 1st memory link ] down-link. A memory control hub may 
transmit a transaction on the 2nd [ of the 2nd memory link ] down-link regardless of 
decoding of a transaction. 
[0008] 

In further another specific working example, a memory control hub may answer decoding 
a transaction to a memory command which has a memory address relevant to a memory 
control hub, and a memory address to adjust, and may also contain a DRAM controller 
which may access a memory chip. 
[0009] 

Although there is room of various corrections and another gestalt in this invention, a 
specific embodiment of this invention is shown in illustration in Drawings, and is 
indicated in detail in Description of this application. However, Drawings and a detailed 
description are not what was meant so that this invention might be restricted to an 
indicated specific gestalt, Please understand having intention of a range covering the 
meaning of this invention which was specified by attached Claims and all the correction 
things within the limits, an equivalent, and a substitute. A title is only the systematic 
purpose and please mind that it is not what meant using in order to restrict or interpret 
Description of this application or Claims. A term of "there there being also a case of - 
which may be - Carried out (may)", a meaning (- that is, it must carry out) of duty — not 
but (must), Please care about being used through an application concerned in the sense of 
permission (that is, a thing which may be - done (having the potential to) and to - do is 
possible (being able to)). A term of "- being included (include)", and its derivative mean 
[ "it not being limited to it, although - is included (including, but not limited to)", and ]. A 
term of "being connected (connected)", A term of meaning "being connected directly or 
indirectly (directly orindirectly connected)", and "being combined (coupled)", It means 
"being combined directly or indirectly (directly or indirectly coupled)." 
[Best Mode of Carrying Out the Invention] 
[0010] 

Hereafter, reference of drawing 1 shows the block diagram of one embodiment of the 
system containing the chain with which serial connection of the memory module was 
carried out. The system 50 contains the host 100 combined with the system memory 125 
via the memory link 1 10A. The system 50 may be constituted, for example so that it may 
operate as some computing devices, such as a computer system or a server system. The 
system memory 125 contains the memory module 150A combined with the memory 
module 150B via the memory ink 1 1 0B. It is combined with the memory link 1 10C 3 and 



the memory module 15 OB is shown, and as long as the memory link 1 IOC needs to form 
the chain with which serial connection of the memory module combined with the host 
100 was carried out, it may be combined with the further memory module (not shown). 
Although two memory modules are shown in the shape of a chain, please care about that 
it is thought that one or more memory modules may be connected in this way. It should 
also care about a certain thing further that the component containing the included 
reference number with which reference characters continue back is generally referred to 
only with a reference number. For example, generally, when referring to all the memory 
modules, the memory module 150 may be referred to. 
[0011] 

In the illustrated embodiment, the memory module 150A may be combined with two or 
more memory devices to which the memory control hubs 160 A were indicated to be the 
memory chips 171 A- 17 IN including the memory control hub 160 A, and N may be 
arbitrary numbers here if needed. In one embodiment, the memory control hub 160 A may 
be combined with a memory chip via memory INTAKONEKUTO arbitrary type. For 
example, in one embodiment, memory INTAKONEKUTO may be a thing of a typical 
address, control, and the configuration of a data bus. 
[0012] 

Similarly the memory module 15 0B may be combined with two or more memory devices 
to which the memory control hubs 160B were indicated to be the memory chips 181A- 
1 8 IN including the memory control hub 160B, and N may be arbitrary numbers here if 
needed. In one embodiment, the memory control hub 160B may be combined with a 
memory chip via memory INTAKONEKUTO arbitrary type, as mentioned above. The 
memory chips 171 A- 17 IN, and 1 81 A-each of 18 IN may be memory devices arbitrary 
type [, such as a memory device of a DRAM system of a memory device, ], for example. 
[0013] 

In the illustrated embodiment, the memory links 1 10A-1 10C form memory 
INTAKONEKUTO. In one embodiment, each of the memory links 1 1 OA- 1 10C forms 
point-to-point memory INTAKONEKUTO given as a two-set one-way line. The one-way 
line of one set is called a down-link, and it is constituted so that a transaction may be 
transmitted in the direction of a downstream from the host 100. The one-way line of 
another set is called uplink, and it is constituted so that a transaction may be transmitted 
to the host's 100 direction in an upstream direction. In one embodiment, the one-way line 
of each set may be given using several different signal pairs. In one embodiment, each 
memory link 1 10 is a signal pair from which each bit differs including an 1 8-bit down- 
link and 16-bit uplink. Memory INTAKONEKUTO formed by the memory link 110 may 
be constituted so that a packet may be transmitted, so that it may indicate still in detail 
below with the description of drawing 5 A - drawing 5 D. 
[0014] 

Speaking generally, all the transactions from the host 100, It flows into a downstream via 
all the memory modules 150 on a down-link, and all the response transactions flow into 
an upstream via each upstream memory module 1 50 on a rise ring from the memory 
module 150 which answers. As long as it says in more detail, in one embodiment, the 
host 100 may request that data is pulled out or stored in the system memory 125. 
Answering the host's 100 request, the memory controller 105 starts corresponding 
transactions, such as a memory read transaction or a memory write transaction, for 



example. The memory controller 105 transmits a transaction to the system memory 125 
via the memory link 1 10A. A transaction is received by the memory control hub 160A of 
the memory module 150A in the illustrated embodiment. 
[0015] 

Reception of a transaction is answered, and without decoding a transaction, the memory 
control hub 160A is constituted so that the transaction received to the memory module 
1 5 OB via the memory link HOB may be transmitted. This is called downstream 
transmission of a transaction. Thus, each transaction received by the given memory 
control hub 160 of the given memory module 150 is transmitted to the next memory 
module 1 50 of the chain combined with the down-link, without decoding a transaction. In 
one embodiment, decoding of a transaction may be produced in parallel with 
transmission of a transaction. In other embodiments, decoding of a transaction may be 
produced, after a transaction is transmitted. The further detailed description about a 
downstream transfer function can be seen below in the description of drawing 3 . 
[0016] 

Similarly, if the memory controller 105 starts a read request transaction, the memory 
module 150 which has the memory locations corresponding to the address of a request 
will answer with the requested data, for example. This response is on uplink of a memory 
module, and is transmitted to the host 100. If there is a memory module which intervenes 
between a transmitting memory module and the host 100, the intervening memory 
module will be on uplink and will transmit a response transaction to either of the next 
memory modules of the chain in the host 1 00 or an upstream direction. A response 
memory module may supply a response to the transaction sequence by which upstream 
transmission is carried out on the rise ring, if the preparation which transmits a response 
is completed. The further detailed description of an upstream transfer function is seen and 
sold to below in the description of drawing 5. 
[0017] 

In one embodiment, even if there is no telling which memory modules 150 A and 150B it 
is that a specific address is related, the memory controller 105 may be constituted so that 
it may request to the system memory 125. For example, each of the memory module 150 
may be assigned to a memory address range into a system configuration sequence. Each 
memory control hub 160 may also contain the logic (not shown in drawing 1 ) which may 
decode the address of a request to input. Thus, the memory control hub 160 of the given 
memory module 150, Decoding of the memory requests which have an address in the 
address range assigned to the given memory module 150 may be answered, and a 
memory read cycle or a memory write cycle may be started to the memory chip on the 
given memory module 150. In order to start a memory cycle to the memory chip 
connected, in one embodiment, each memory control hub 160 may also contain a DRAM 
controller (not shown in drawing 1) , so that it may indicate still in detail below with the 
description of drawing 2 . 
[0018] 

In one embodiment, the memory controller 105 may start the following memory access 
request, before receiving the response to a front memory access request. In such an 
embodiment, the memory controller 105 may process a response in a different order from 
what could pursue the remarkable request, therefore was transmitted. 
[0019] 



In another embodiment, each of the memory link 110 may form point TSUU point 
memory INTAKONEKUTO given as one-set bidirectional lines. Thus, the transaction of 
both an upstream and a downstream may flow on a bidirectional wire set. In such an 
embodiment, bidirectional lines may be given using several different signal pairs. 
[0020] 

Reference of drawing 2 shows the block diagram of one embodiment of memory modules, 
such as a memory module shown in drawing 1 . In order to clarify and simplify, the same 
reference number is given to the component corresponding to what is shown in drawing 1 . 
The memory module 150 contains the memory control hub 160 combined with the 
memory chips 261A-261N via the memory bus 265. The memory control hub 160 
contains the control unit 240 combined with DRAM controller 250. DRAM controller 
250 is combined with the memory chips 261 A-261N. The control unit 240 includes the 
uplink control 241 and the down-link control 242. As mentioned above, the memory bus 
265 may be memory INTAKONEKUTO arbitrary type. The memory control hub 160 is 
combined with the memory link 1 1 OA in an upstream direction, and the memory link 
HOB which exists in the direction of a downstream in the illustrated embodiment. The 
clock frequency of the memory bus 265 should mind further that it is unrelated to the 
clock frequency of the memory link 110. 
[0021] 

In the illustrated embodiment, the uplink control unit 241 may be constituted so that the 
packet which received from another memory module downstream may be received and 
transmitted. An upstream transaction sequence arises by receiving and transmitting an 
upstream packet. The uplink control unit 241 may be constituted so that the packet 
generated within the memory module 1 50 may be supplied to a transaction stream. 
[0022] 

If it may be constituted so that the packet which the down-link control unit 242 generates 
in a host may be received in the illustrated embodiment, and a memory module is 
connected to a downstream, It may be constituted so that these packets may be 
transmitted to a downstream memory module. The down-link control unit 242 may be 
constituted so that a packet may be copied and decoded. Including the address which has 
a packet in the address range assigned to the memory module 150 in one embodiment, if 
a packet is a memory access request, The down-link control unit 242 may send the 
command relevant to a packet to DRAM controller 250. In one embodiment, DRAM 
controller 250 answers the memory command from the memory control hub 160, and it is 
constituted so that a memory cycle may be started to the memory chips 261A-261N. 
However, as long as a packet is not memory requests but a configuration packet, the 
down-link control unit 242 may send the configuration command relevant to a packet to 
the core logic of the control unit 240 (not shown) for processing. If a packet does not 
include the address in the address range assigned to the memory module 150 in one 
embodiment, the memory control hub 160, If the memory module 150 is a memory 
module of the last of a chain, please care about that a packet may be canceled or canceled. 
[0023] 

In one embodiment, the memory control hub 160, When it is constituted so that a module 
existence signal (not shown) may be received, and this signal is activated with a 
downstream memory module, it is shown in an upstream memory module that a 
downstream memory module exists. In such an embodiment, as long as it is determined 



that there is no downstream memory module in which the memory control hub 160 
receives a transaction, and exists, the memory control hub 160 may cancel a transaction. 
In one specific working example, if the given memory module 150 is inserted in a socket, 
the inserted memory module may apply the signal ground to a module existence signal. 
Thus, an active module existence signal is an active low signal. 
[0024] 

When the signal ground is applied in the embodiment mentioned above, a module 
existence signal is active, but in other embodiments, please care about that it is possible 
that other voltage levels may be applied to a module existence signal so that it is shown 
that a memory module exists. 
[0025] 

Reference of drawing 3 shows the block diagram of one embodiment of a down-link 
control unit. In the embodiment shown in drawing 3 , the down-link control unit 342 may 
express the down-link control unit 242 shown in drawing 2 . The down-link control unit 
342 receives a downstream transaction on the down-link 31 2 A, and it is combined so that 
these downstream transactions may be transmitted on the down-link 3 12B. In one 
embodiment, the down-links 312A and 312B may express each of the down-links 212A 
and 212B of drawing 2 . As mentioned above, the down-links 312A and 312B should care 
about that two or more bits are included. For example, in one working example, each of 
the down-links 312A and 3 12B may be an 18-bit down-link. The down-link control unit 
342 receives the busy signal 371 from an upstream memory module or the host 100, and 
it is constituted so that the busy signal 372 may be transmitted to a downstream memory 
module. 
[0026] 

In the illustrated embodiment, the down-link control unit 342 contains the phase 
alignment unit 310 which receives an input transaction. The phase alignment unit 310 is 
combined with the transmission unit 315 and the data restoration unit 320. The data 
restoration unit 320 is combined with the synchronous first in first out buffer 
(FIFO:firstin first out) 325 combined with the address decoding logic 330. Synchronous 
FIF0325 is combined with DRAM controllers, such as DRAM controller 250, and the 
core logic in the control unit 240 of drawing 2 in one embodiment. In the embodiment 
shown in drawing 3 , the phase alignment unit 310, the transmission unit 315, and the data 
restoration unit 320 should care about that it may operate in each bit of a down-link 
independently by bitwise. In other embodiments, the phase alignment unit 310, the 
transmission unit 315, and the data restoration unit 320 can consider that it may operate 
in all the bits of a down-link simultaneously substantially. 
[0027] 

In order to give required memory band width, the memory control hub 1 60 can become 
important [ transmitting the received transaction to a downstream memory module 
efficiently ]. Therefore, the transaction which the down-link control unit 342 received is 
thoughtlessly transmitted to a downstream. In one embodiment, phase alignment is 
carried out by the phase alignment unit 310, and each receiving bit is transmitted to the 
transmission unit 3 15, in order to transmit by the down-link 312B, without decoding. 
Each receiving bit is transmitted to the data restoration unit 320, in order to process. 
[0028] 

In one embodiment, in order that the down-link control unit 342 may enable it to sample 



in the center of a received-data eye, the phase alignment unit 3 10 is constituted to each 
bit so that the phase of local sampling clocks may be adjusted dynamically. For example, 
in one embodiment, a reference clock is given from a host to the phase locked loop 
(PLL:phased locked loop) (not shown) in the down-link control unit 342. PLL generates a 
transmission clock with local sampling clocks in the down-link control unit 342. The 
phase alignment unit 3 10 is constituted so that tracking of the average phase of an input 
data stream may be carried out. The phase alignment unit 310 compensates again the 
static skew produced by a process variation, Tracking of the low frequency wave change 
of the data phase produced by change of voltage and temperature may be carried out, and 
it may exist in a reference clock, and it may be constituted so that the arbitrary low 
frequency wave phase jitters in which tracking is not carried out by PLL of a hub may be 
compensated. The phase alignment unit 310 filters the high frequency jitter produced by 
intersymbol interference, a cross talk or the reflection noise, and the high frequency 
phase noise that may be generated with a transmitter. 
[0029] 

In order to perform phase alignment of local sampling clocks, it may be required to give a 
sufficient number for each bit of the down-link 3 12A of transition (or penetration 
density). In one embodiment, transition density will be given by descrambling received 
data, if it receives after carrying out the scramble of the data transmitted to each bit. In 
one embodiment, the scramble of the data is carried out by carrying out EXCLUSIVE 
OR operation (XOR:Exclusive-OR) of the data by a pseudo-random binary sequence 
(PRBSrpseudo random binary sequence). A linear feedback shift register (LFSRilinear 
feedback shift register) may generate PRBS using a given seed polynomial. In another 
embodiment, transition density may be given by transmitting the synchronous packet 
which has predetermined data payloads. In such an embodiment, predetermined data 
payloads may also contain random or the pseudo-random pattern which has a sufficient 
number of transition. 
[0030] 

It is not concerned with the acquiring method of transition density, but the data 
restoration unit 320 is constituted so that a data bit may be recovered. In the embodiment 
using scramble, using the same PRBS as what is used in order to carry out the scramble 
of the data, the data restoration unit 320 may be constituted so that received data may be 
descrambled. On the contrary, in order to gain transition density, in the embodiment to be 
used, a synchronous packet the data restoration unit 320, After the phase alignment unit 
310 ends alignment of local sampling clocks, only canceling synchronous packet data or 
canceling them also has it. [ good ] 
[0031] 

In the illustrated embodiment, synchronous FIF0325 is constituted so that the input data 
bit for using it by the core logic of the control unit 240 may be stored, for example, a 
transaction — a packet — since it is-izing and transmitted, a receiving bit is stored in 
synchronous FIF0325, and it may be reformatted in order to decode. Subsequently, a 
receive packet is decoded by the address decoding logic 330. As mentioned above, a 
memory address range may be assigned to each memory module 150. The hub address 
for using it for each memory control hub 1 60 in a configuration transaction may be 
assigned. Command information may be extracted and processed, as long as a transaction 
address is decoded and consistency is shown. In one embodiment, as long as a transaction 



is a memory access request which has an address which adjusts the memory address 
relevant to the memory control hub 1 60, the decoded command may be transmitted to 
DRAM controller 250. As long as a transaction is a configuration transaction, the 
decoded command may be transmitted to the core logic of the control unit 240. A packet 
may be canceled or canceled if an address decoding logic section or the address decoding 
logic 330 does not detect consistency. 
[0032] 

In the illustrated embodiment, the phase alignment unit 335 is combined so that the input 
busy signal 371 may be received. The phase alignment unit 335 is combined with the data 
restoration unit 350 again, and this unit 350 is combined with the busy pulse injection 
unit 355. The busy pulse injection unit 355 is combined with the transmission unit 360. 
[0033] 

In the illustrated embodiment, the phase alignment unit 335 and the data restoration unit 
350 are similar to each of the phase alignment unit 310 and the data restoration unit 320, 
and operate. However, in one embodiment, the busy signal 371 is a single bit difference 
part signal, and is not a multibit signal. The busy signal 371 and the busy signal 372 are 
used in order to leave sufficient idle time for the hub which has a hub near the bottom 
product of the serial chain of a memory module near the top of a serial chain to supply a 
packet. In one embodiment, the busy signal 371 includes a number of a packet of 
directions supplied to an upstream transaction sequence with all the memory modules in 
an upstream. Therefore, the busy signal 372 includes the total of the packet supplied to an 
upstream transaction sequence with all the memory modules in an upstream, and a 
number of a packet of directions which are locally supplied by the memory control hub 
160. 
[0034] 

In one embodiment, the busy pulse injection unit 355 is constituted so that the data 
corresponding to the packet number which will be supplied to an upstream transaction 
sequence with all the memory modules in an upstream may be received. The busy pulse 
injection unit 355 is constituted so that directions may be received from the core logic of 
the control unit 240 corresponding to the number of the packets which will be locally 
supplied to an upstream transaction sequence by the memory control hub 160. Therefore, 
the busy pulse injection unit 355 is constituted so that the busy signal 372 may be made. 
In one embodiment, the busy signals 371 and 372 may also include a pulse to each 
injection packet. Thus, signals, such as the busy signal 372 showing five packets supplied, 
will include five pulses, for example. However, please take into consideration that 
arbitrary numbers of pulses may be included to each injection packet in other 
embodiments. A packet may be transmitted as a short packet or a long packet so that it 
may be indicated further below. Therefore, in one embodiment, in the case of the 
supplied long packet, as for the busy pulse injection unit 355, each merit may be, and it 
may also include two pulses to a packet. 
[0035] 

The busy pulse injection unit 355 is constituted so that the directions corresponding to the 
number of the busy pulses received from the upstream to the uplink control unit 241 of 
drawing 2 m ay be given. If a memory module is a module of the last of the chain by 
which serial connection was carried out in one embodiment, the uplink control unit 241, 
According to the number of the busy pulses received on the busy signal 371, one or more 



NOP packets may be made to be supplied to an upstream transaction sequence. For 
example, in one working example, the uplink control unit 241 may be made to throw one 
NOP packet into an upstream transaction sequence every two busy pulses which received. 
However, other embodiments for which other ratios of an NOP packet and a receiving 
busy pulse may be used can be considered. 
[0036] 

In the illustrated embodiment, the transmission unit 360 is constituted so that a busy 
signal may be received from the busy pulse injection unit 355. In one embodiment, as 
mentioned above, LFSR is used for the transmission unit 360 before transmission of the 
busy signal 372, and it is further constituted so that the scramble of the data may be 
carried out. As other gestalten, the transmission unit 360 may supply a synchronous 
packet, as mentioned above. 
[0037] 

Reference of drawing 4 shows the block diagram of one embodiment of an uplink control 
unit. In the embodiment shown in drawing 4 , the uplink control unit 441 may express the 
uplink control unit 241 shown in drawing 2 . The uplink control unit 441 receives an 
upstream transaction on the uplink 41 IB, and it is combined so that an upstream 
transaction may be transmitted on the uplink 41 1 A. The uplink control unit 241 is 
constituted so that a packet may be supplied to the upstream transaction sequence 
received on the uplink 41 IB. In one embodiment, the uplinks 41 1 A and 41 IB may 
express each of the uplinks 21 1 A and 21 IB of drawing 2 . As mentioned above, the 
uplinks 41 1 A and 41 IB should care about that two or more bits are included. For 
example, in one working example, each of the uplinks 41 1 A and 41 IB may be 16-bit 
uplink. 
[0038] 

In the illustrated embodiment, the uplink control unit 441 contains the phase alignment 
unit 410 which receives an input upstream transaction. The phase alignment unit 410 is 
combined with the data restoration unit 415. 
[0039] 

In order to give required memory band width, the memory control hub 160 has that it is 
also important to transmit a receiving upstream transaction to an upstream memory 
module or a host efficiently. The transaction which the uplink control unit 441 received is 
transmitted to an upstream like the downstream control unit 342. However, the uplink 
control unit 441 may supply the packet generated locally to an upstream transaction 
sequence by contrast [ the downstream control unit 342 ]. 
[0040] 

In the illustrated embodiment, the phase alignment unit 410 operates like the phase 
alignment unit 310. Therefore, to each bit, in order that the uplink control unit 441 may 
enable it to sample in the center of a received-data eye as mentioned above, the phase 
alignment unit 410 is constituted so that the phase of local sampling clocks may be 
adjusted dynamically. Similarly, as mentioned above with the description of the data 
restoration unit 320, the data restoration unit 41 5 is constituted so that a data bit may be 
recovered. 
[0041] 

The data restoration unit 41 5 is combined with the multiplexer 430 combined with the 
transmission unit 435 in the illustrated embodiment. If there is no packet supplied to an 



uplink transaction sequence in the uplink control unit 441, the uplink control unit 441 is 
constituted so that the transaction received on the uplink 41 1 A may be transmitted. The 
packet boundary track unit 450 may give a control signal to the multiplexer 430, and 
carries out the scramble of the received transaction by the multiplexer 430, and it may 
enable it to transmit with the transmission unit 435 in one embodiment. In one 
embodiment, the transmission unit 435 may carry out the scramble of the data transmitted 
using LFSR, as mentioned above, but in other embodiments, the transmission unit 435 
may supply a synchronous packet, as mentioned above. 
[0042] 

However, in one embodiment, when the packet supplied is received and stored in 
injection FIF0425 from hub core logic, the received data from the data restoration unit 
415 are stored in maintenance FIFO420, in order to transmit later. Completion of 
transmission of the packet transmitted now will give the data stored in injection FIF0425 
to the input of the multiplexer 430. The packet boundary track unit 450 carries out 
tracking of the packet boundary of the packet which received from the uplink 41 IB. The 
supplied packet with the packet boundary track unit 450, By giving a control signal to the 
multiplexer 430 at exact time, by not being in agreement with the transmitted packet, the 
scramble of the waiting packet poured in can be carried out, and it can transmit now with 
the transmission unit 435. If it assumes that there are a packet which is the injection 
schedule stored in injection FIF0425, and a packet of the transfer schedule stored in 
maintenance FIFO420, The packet boundary track unit 450 may control the multiplexer 
430 selectively according to a fairness algorithm (fairness algorithm) to send one type of 
the packets to the transmission unit 435. Fairness algorithms may be arbitrary algorithms 
constituted so that either the injection packet to arbitrary given memory modules or 
forward packets might not run short. Please care about that it may be canceled instead of 
the NOP packet which received on the uplink 41 IB being stored in the maintenance 
FIF420, or being transmitted. 
[0043] 

In another embodiment, in order to improve the waiting time of the transmitted 
transaction traffic, the phase alignment unit 410 should care about that it may be 
combined with maintenance FIFO420 and the multiplexer 430 so that a dashed line 
shows. According to such an embodiment, waiting time may be improved when injection 
traffic does not exist. 
[0044] 

In one embodiment, before communication between the host 100 and each memory 
control hub 160 of each memory module 150, A start sequence may be performed in 
order to synchronize arbitrary scramble / descrambling logic which may exist in the host 
100 and each memory control hub 160, synchronous FIFO, and phase alignment logic. 
For example, in one embodiment, a start sequence may also contain during reset the host 
100 who transmits one or more alignment patterns to a downstream. By each memory 
control hub 160, an alignment pattern may be transmitted to an upstream and may be 
returned to the host 100. An alignment pattern may be used so that a receiver including 
scramble / descrambling logic can lock a synchronization. 
[0045] 

(Memory INTAKONEKUTO) 

When drawing 1 and drawing 2 are referred to collectively, memory INTAKONEKUTO, 



Including one or more high-speed point TSUU point memory links, such as the memory 
links 1 10A-1 IOC, each of the memory links 1 10A-1 IOC includes down-links, such as 
uplink of the uplink 21 1 A etc., and the down-link 212A, for example. As mentioned 
above, in one embodiment, a down-link may be an 18-bit link and uplink may be a 16-bit 
link. Thus, an 18-bit down-link may also include 16 control address information 
(CAD:control, address and data) signal, a busy signal, and a control (CTL:Control) signal. 
Given uplink may also include 16 control address information (CAD) signal. However, in 
another embodiment, it is also possible that uplink of the uplink 21 1 A etc. may include a 
CTL signal. 
[0046] 

Other signals may be given to each memory module 1 50 other than a high-speed link. For 
example, in one embodiment, a reset signal, a power OK signal, and a reference clock 
may be given to each memory module 150 from the host 100. Other signals may be given 
between each memory module. For example, as mentioned above, the following memory 
module existence signal may be given between memory modules. 
[0047] 

Speaking generally, classifying into a configuration and a control transaction, and a 
memory transaction the type of the transaction transmitted on the memory link 1 10. In 
one embodiment, since the memory control hub 160 is constituted, a configuration and a 
control transaction may be used. For example, a configuration and a control transaction 
may be used so that configuration registers may be accessed, and a memory address 
range may be assigned to a memory module or a hub address may be assigned to a 
memory module hub. A memory transaction may be used in order to access the memory 
locations in the memory chip 261 A - 26 IN. 
[0048] 

Therefore, in one embodiment, there are two types of addressing currently supported, hub 
addressing and memory addressing. If hub addressing is used, 8 hub bit will identify the 
specific memory control hub accessed. In one embodiment, the hub address of FFh may 
express the simultaneous transmissive communication to all the memory control hubs. 
Using memory addressing, each hub decodes a lower part, in order to decode the upper 
part of an address bit in order to determine which hub should receive a request, and to opt 
for the memory locations accessed. In one embodiment, although there are 40 address 
bits, it is possible that the address bit of other numbers may be used if needed. 
[0049] 

In one embodiment, each of a memory link is constituted so that a transaction may be 
transmitted using one or more packets. A packet may also contain data payloads 
according to the type of a command with which a packet conveys those each including 
control and a configuration packet, and a memory access packet. Thus, the wire set which 
constitutes the memory link 110 may be used in order to transmit control, an address, and 
data. 
[0050] 

A packet may generally be characterized by each packet for the bit portion of a large 
number which transmit the information on a single bit to be included. Each packet is 
divided into several bit time, and all the bit portions of a packet are sampled between 
given bit times. Thus, control information and data share the same wire (for example, 
CAD wire) of a given link. In one embodiment, a packet is a multiple of a bit pair and the 



bit time of the beginning of all the packets is sampled in an equal bit time so that it may 
indicate still in detail below. A packet starts with the control header whose length may be 
either a 1-bit pair or a 2-bit pair. In one embodiment, the first 5 bits of a control header 
are command code. Following Table 1 indicates the command code relevant to them to 
be a packet various type. However, the actual code shown in the 1st row is a thing for the 
purpose of illustration, and please care about that other codes may be used for a 
command given [ each ]. 
The Table 1 packet type and command code 

| Direction [ of code | header | command | description | ] | normal response | Adlai | 
1 1 length (BI j 1 1 1 1 SUTAI |) 
| | TTOTA 1 1 1 1 1 PU | 
IIYimlllMI 

| It is | — |-NOP-|-operation-less/| bidirectional |- 1- | OOh. 
I 1 1 I idol-like | | | | 
I 1 1 1 voice 1 1 1 1 

| 04h|2 |AddrSet | ADORESUSE | down |Addr | hub | 
Mil TTO | |Ack 1 1 

j 05h|2 | AddrAck | address private seal | rise |- |- | 

1111**1111 

| 06h|2 |Ack | recognition | rise |- 1- | 

I Don't do 07h|2 |Nak | recognition of, but it is /| rise |- 1- 1. 

| 1 1 1 error 1 1 1 1 

| 08h|2 ISRdResp | - short lead | rise |- |- | 
| 1 1 | response | | | | 

I 09h|2 |LRdResp | ~ long lead | rise |- |- | 
j 1 1 1 response MM 

j 0Ah|2 |ConfigRd | KONFIGI | down |RdResp | hub | 
| 1 1 | YURESHO | | | | 
| j||NRIDO|||| 

j 0Ch|2 IConfigWr | KONFIGI | down |Ack | hub | 
| 1 1 | YURESHO | | | | 
1 1 1 1 NRAITO 1 1 1 1 

| 0Eh|2 |DIMMCtl |DIMM system | down |Ack | hub | 
I 1 1 1 -- I I 1 1 

| 10h|4 |SMemRd | - short memory | down |RdResp/Ack| memory | 
| 1 1 | lead | | | | 

| 1 lh|4 |LMemRd | - long memory | down |RdResp | memory | 
| 1 1 1 lead 1 1 1 1 

j 12h|4 |BlkMemWr | BUROKKUME | down |Ack | memory | 
| | 1 1 MORIRAITO | 1 1 | 

| 13h|4 |SbytMemWr| ~ short byte | down |Ack | memory | 
| | | | memory rye | | | | 

t||| to MM 

I 14h|4 |LbytMemWr| - long byte | down |Ack | memory | 
j | 1 1 memory rye 1 1 M 
I II I TO 1 1| | 



[0051] 

In one embodiment, a packet (except for an NOP packet) is transmitted with an error 
detection code (EDC:error detecting code). In one embodiment, although EDC is a 32-bit 
cyclic redundancy code (CRC:cyclic redundancy code), please care about that the thing 
of other EDC may be adopted in other embodiments if needed. Data is first transmitted 
by a least significant byte to an address being first transmitted to high-speed decoding in 
the memory control hub 160 in a most significant bit time. However, please care about 
that an address may be first transmitted in a least significant bit time, and data may be 
first transmitted by the most significant byte in other embodiments. A packet may convey 
the pay load of byte enabling and/or data. A packet without a pay load is called a header- 
only packet. In one embodiment, the size of the short data of a lead may be a half of the 
cash linesize programmed at the maximum. The size of the long data of a lead and block 
write may be the cash linesize programmed at the maximum. The data size of a byte light 
may be the greatest 64 bytes irrespective of setting out of cash linesize. 
[0052] 

The CTL signal other than a control header and command code information included in a 

packet may be used in order to transmit the information about each packet. As shown in 

following Table 2, some illustration CTL coding is shown. 

Table 2 CTL coding of downstream use 

Contents [ of ** even number ** odd number ** CAD ] ** 

** o ** 0 ** data or by TOINEBU** 

** ** ** RUPEI load** 

** i ** i ** control header ** 

** of a packet with a ** 0 ** 1 ** pay load 

C**ofa** 1 **0** head-only packet 

** ** ** 

[0053] 

Sufficient information which enables it to insert a header-only packet into the pay load of 
another packet because the header of a packet differs from the value of CTL of a payload 
part may be given. While the light packet is transmitted on the link, this is enabling it to 
emit a read command, and in order to reduce the waiting time of a read command, it has a 
useful thing. Table 3 shows the illustration packet which contains a pay load by a tabular 
format. The packet of Table 3 shows that the header-only packet is inserted in a pay load 
between the bit times 4-7. 

Table 3 Packet with pay load, and header-only packet inserted into pay load 

** bit time **CTL **CAD ** 

1 bit of ** 0 ** 1 ** headers [15:0] ** 

1 bit of ** 1 ** 1 ** headers [31:16] ** 
** 2 **0** data bit [15:0] ** 

** 3 ** o ** data bit [31:16] ** 

2 bits of** 4**1** headers [15:0] ** 
2 bits of ** 5 ** 1 ** headers [31:16] ** 
2 bits of ** 6 ** 1 ** CRC [15:0] ** 

2 bits of** 7 ** 0 ** CRC [31:16] ** 
** g ** o ** data bit [47:32] ** 



** 9 ** o ** data bit [64:48] ** 

1 bit of** 10 ** 0 ** CRC [15:0] ** 

1 bit of** 11** 1 ** CRC [31:16]** 

[0054] , . , . 

Drawing 5 A - drawing 5 D show the illustration packet which may be transmitted on the 
memory link 1 10A of drawing 1 - 1 IOC. Hereafter, reference of drawing 5 A shows the 
figure of one embodiment of a configuration lead packet. In the illustrated embodiment, 
the configuration lead packets 5 1 0 are 1 6 bit width, and contain a 4-bit time or a 2-bit 
pair. 

[0055] . . 

5-bit command code (for example, OAh) is transmitted to the bit positions 0-4 between 
the bit times 0. Let the bit positions 5-7 be reserves. An 8-bit tag is transmitted to the bit 
positions 8-15. In one embodiment, since a remarkable downstream request and an 
upstream response packet are adjusted for example, tag values may be used by the host 
100. If not used, a tag field may be set as the value of 00 h. An 8-bit hub address is 
transmitted to the bit positions 0-7 between the bit times 1 . The number of 8-bit 
configuration registers is transmitted to the bit positions 8-15. The bits 0-15 of CRC, and 
16-31 are transmitted to the bit positions 0-15 between the bit times 2 and 3, respectively. 

[0056] . 
Reference of drawing 5 B shows the figure of one embodiment of a configuration light 
packet. In the illustrated embodiment, the configuration light packets 515 are 16 bit width, 
and contain a 6-bit time or a triplet pair. 

[0057] . . 

5-bit command code (for example, OCh) is transmitted to the bit positions 0-4 between 
the bit times 0. Let the bit positions 5-7 be reserves. An 8-bit tag is transmitted to the bit 
positions 8-15. An 8-bit hub address is transmitted to the bit positions 0-7 between the bit 
times 1 . The number of 8-bit configuration registers is transmitted to the bit positions 8- 
1 5 The bits 0-1 5 of data payloads, and 1 6-3 1 are transmitted to the bit positions 0-1 5 
between the bit times 2 and 3. The bits 0-15 of CRC, and 16-31 are transmitted to the bit 
positions 0-15 between the bit times 4 and 5, respectively. 

[0058] c , i ♦ 

Reference of drawing 5 C shows the figure of one embodiment of a memory read packet. 
In the illustrated embodiment, the memory read packets 520 are 16 bit width, and contain 
a 6-bit time or a triplet pair. 5-bit command code (for example, 1 Oh or 1 lh) is transmitted 
to the bit positions 0-4 between the bit times 0. Let the bit positions 5-7 be reserves. An 
8-bit tag is transmitted to the bit positions 8-15. 

[0059] . . „ 

The length of the data which should return to the bit positions 0-5 is transmitted between 
the bit times 1. In one embodiment, it is shown that the value of 00 h does not have data, 
the value of 01 h shows the data of a 2-bit pair, and the value of 02 h shows the data of a 
4-bit pair, and is the same as that of the following. A recognition packet 
(Ack:acknowledge packet) is returned to a requester as the length of a lead is zero. In one 
embodiment, since short RdResp arises with the lead of the cache line below half, either 
single long RdResp or two short RdResp(s) may arise with the lead of a bigger cache line 
than a half. The size of a cache line may be programmed by the configuration registers of 
the host 100 and each memory control hub 160 with software. Let the bits 6-7 be reserves. 



The address bits 39-32 of the place where DRAM was requested to the bit positions 8-15 
are transmitted. 

[0060] ogress bits 31-16 of the place where DRAM was requested 

mmMmmm- 

TeserJi The S2l5 of CRC, and 1 6-3 1 are transmitted to the bit positions 0-1 5 
between the bit times 4 and 5, respectively. 

Reference of drawing 5 D shows the figure of one embodiment of a Hock memory write 
reserves. An 8-bit tag is transmitted to the bit positions 8-15. 

positions 8-15 are transmitted. 

[0063 L u + ^1 1 * nf tV, e nlace of DRAM currently written in the bit positions 0-15 
The address bits 31-16 of the place oiukamc J f h , 0 f DRAM 

are transmitted between the bit times 2, and the address brts 3 1 5 ot trie pia 

position 2 be a reserve. 

EL 0-15 of the 1st bit pair of data payloads, and 16-31 ™J™r^£^ m 

Sit JTrfSOT ^ - d t'he oi, positions 0-15 between bi, 
time 4+2N and 5+2N, respectively. 

embodiments. 

gSLiL is a block diagram of one embodiment of a computer system. The computer 



i ^ioa ai ?d to which interconnection of each was 
system 600 contains the process nodes Each link of the coherent packet 

carried out by coherent packet interface ^AEM li g ^ ^ 

interface 615 may form a high-speed P°^™ ^ • £ ins in 

A-D may also include one or more processes. The computer ^ m acket 

fte I/O »o*~ in 

612A is shown as a host node, and may a so uKtade _tte nosti ■ g 

with the I/O node 620 via the NC P^^^o'^eT^™) again .V 
inelude the host bridge for corrnnumcatmg wtth ote I/O noc ^ t ^ ^ a 

&ishows the —nding system memory (for example ^Aand 6178^ ^ 

eombined ^^^^^^ J^im^ «* »* 

.he process nodes 612A and 612B expresses ^a nos a with the description of drawing 

memory 617 may be given to * e ( ^» a ^^^ N EKUTO between each of me 
Landto^^h ^ menhon ^ ™°^_ nding to them may 

process nodes 612A "^TO including the memory link HOC menttoned above 
memory 617, for example. 

t 00681 , u a- t ,*rh link of the coherent packet interface 615 is given as a 

In the illustrated embodiment, eac h link o L ^ c oneren p ^ & t 

set of a one-way line (for -^^^^ line 615B is used in order 

to the process node 612B from the process noae < o , ^ ^ ^ 

to transmit a packet to the process node 612C nodes as shown in 

615 C-D is used in order to transmit a packed unong °^ C ™ZLcXe between 
drawingjL. In order that the f^J^^^^^i^ link"). In order that 
process nodes, it may operate at ^^^^ScTbetlveen I/O nodes and among 
the un-coherent packet interface 650 may commun, ^^betwe ^ 
host bridges, such as a host bridge of an I/O ^nd tne pr rf ^ or 

operate at an un-coherent ceremony C™^3 adherent fabric." Similarly, the 
more nodes through a coherent link may be called a coherent t ^ 

coherent fabric. Please care auuut t r example, the packet 

process node may pass one «™g££^*Z fSnay pi s either me 

embodiment shown in drawing 6. 



[0069] 



One examp.e of*. packet -*.t««,^SK 5 ^^ 

HyperTransport™ art. T^g*^ ^ mT^ONEKUTO (Peripheral 

be used. 

S care about tamer orher cornprner ^t^^S^ned 
thinking. Far example it » pay Ale to Uhe ay* ^ ^ which adapted the 

S in a'north bridge may function as a host. 

XUnteenrbadhn - fS £-«SS£ ^S^by 
skilled in the art, many * S 0 X»8hly. It has intention of bemg 

[Industrial applicability] 

&ntion on be applied ,0 a computer system memory, and is generally obtained. 
[Brief Description of the Drawings] 

s^t rss'si^- — «— ° f down - iink contto1 uni,s ' "* as a 

SSS2^ rock^ri&— ' °f — 4 such * an 

uplink control unit shown in toH^^ configuration lead packet. 

[Drawing 5 A] It is a figure of one embodimen ot a Ught packet . 

Drawing 5 B] It is a figure of one emboduuent ot a e g ^ 
Drawing 5 C] It is afigure of °^£^ °f amem oiy write packet. 
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